Ford Disclosure No. 200-1451 

SYSTEM AND METHOD OF INTERACTIVE 
EVALUATION OF A GEOMETRIC MODEL 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates generally to 
computer-assisted design of vehicles and, more 
specifically, to a system and method of interactive 
evaluation of a geometric model in the computer- 
assisted design of a vehicle. 

2 . Description of the Related Art 

Vehicle design, and in particular the design 
of an automotive vehicle, has advanced to a state in 
which computer assisted design techniques are 
frequently incorporated in the development of a new 
vehicle, or redesign of an existing vehicle. Enhanced 
visualization software tools allow for interactive 
display and manipulation of large geometric models, 
including models developed using computer aided design 
(CAD) . In the field of vehicle design, the use of 
computer aided design and visualization techniques are 
especially beneficial in designing, packaging, and 
assembling the various systems incorporated within the 
vehicle, to maximize the design and functional 
capabilities of these vehicles. Advantageously, 
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potential vehicle system designs can be considered in a 
timely and cost-effective manner by analyzing a digital 
representation of a proposed design, versus preparing 
an actual vehicle model. 
5 One aspect of the design task for a vehicle 

is the coexistence of a CAD generated geometric model 
and a physical model. An advantage of the physical 
model is that it provides a physical ■ representation of 
the design that can be evaluated visually and by touch. 

U 10 For example, a clay model allows a designer to assess a 

surface quality of the model through multi-fingered, 

Ul two handed, dexterous manipulation of the model. 

01 Designers often trace the contour of a vehicle surface 
s with their fingertips and palm, to obtain tactile 
fy 15 information to assess surface fairness. A disadvantage 
[2 of the physical model relates to transforming the 

2 physical model back into the original CAD format after 

the designer has modified the physical model. 

The geometric model of a proposed design is 
20 constructed using a technique such as computer-aided 
design (CAD) . An advantage of a CAD model is that 
known mathematical tools, such as computer-aided 
engineering (CAE) , are available to constrain and guide 
the designer in evaluating the design. Also, the 
25 construction steps involved in creating the geometric 
model can be recorded for later use. The geometric 
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model can easily be updated using the construction 
steps in light of a new set of parameters. A 
disadvantage of a CAD model relates to viewing a 3- 
dimensional model in 2-dimensions on a display device. 
5 Recently, designers have utilized virtual 

reality simulation techniques to provide a bridge 
between the physical model and the CAD model. Virtual 
reality allows a user to interact with a virtual 
environment, including a virtual object in the virtual 

10 environment, as if the user was actually immersed in 
the virtual environment. It should be appreciated that 
a virtual object within the virtual environment may 
include a virtual surface. 

A user-friendly physical device, such as a 

15 haptic device, serves as an interface between the user 
and the virtual environment. Advantageously, the haptic 
device reproduces at a high rate of speed the sensation 
of freely moving an object within a constrained 
environment by determining the forces exchanged between 

20 the interacting geometries. This process is frequently 
referred to as haptic rendering. An example of a haptic 
interface is disclosed in U.S. Patent No. 5,694,013 to 
Stewart et al., entitled ''Force Feedback Haptic 
Interface for a Three-Dimensional CAD Surface'', the 

25 disclosure of which is incorporated by reference. 
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Haptic rendering provides the user with 
information regarding the virtual surface using force 
feedback from a single point of contact. In particular, 
haptic browsing refers to the tactile interaction and 
5 visualization of the geometric surface using a haptic 
interface. An example of a methodology of haptic 

browsing is disclosed in U.S. Patent No. 5,844,392 to 
Peurach et al . , entitled ''Haptic Browsing", the 
disclosure of which is incorporated by reference. 
O 10 While the method disclosed by Peurach et al . ^392 uses 

haptics to present information regarding a single 
in point, it does not constrain the haptic interface to 

yl the surface of the geometric model to convey 

kinesthetic or tactile information. Thus, there is a 
m 15 need in the art for a system and method of interactive 

2 evaluation of a geometric model using a haptic 

2 interface constrained to a virtual surface within the 

virtual environment, in order to assess a geometric 
property associated with the virtual surface. 

20 

SUMMARY OF THE INVENTION 

Accordingly, the present invention is a 
system and method of interactive evaluation of a 
geometric model. The system includes a computer system 
25 having a memory, a processor, a user input device and a 
display device. The system also includes a computer 
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generated geometric model stored in the memory of the 
computer system. The system further includes a haptic 
interface operatively in communication with the 
computer system, wherein the haptic interface includes 
5 a haptic device for transmitting information between a 
user and the geometric model. 



haptic device position and orientation with respect to 
a surface of the geometric model and mapping the haptic 

10 device position and orientation into a geometric model 
coordinate reference system. The method also includes 
the steps of determining a closest point position and 
orientation on the surface of the geometric model to 
the haptic device position and extracting a surface 

15 property at the closest point position and orientation. 
The method further includes the steps of determining a 
stick-to-surface force and a property feedback force 
using the surface property at the closet point position 
and orientation and applying the stick-to-surface force 

20 and property feedback force to control a location and 
force output of the haptic device. 



that a system and method of interactive evaluation of a 
geometric model is provided that constrains a user' s 
25 motion to stick to a surface of a geometric model 
within a virtual environment. Another advantage of the 



The method includes the steps of acquiring a 



One advantage of the present invention is 
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present invention is that a system and method is 
provided for haptically browsing the surface of the 
virtual model, thus allowing the user to assess a 
physical property of a surface, such as smoothness or 
5 fairness. Still another advantage of the present 
invention is that a system and method is provided that 
bridges between the physical model and the CAD model by 
allowing the user to touch the CAD model using virtual 
reality technology. Still yet another advantage of the 
Q 10 present invention is that the system and method 

SA' integrates tactile feedback in a force enabled 

ifl simulation to constrain physical interaction of the 

fp user to the virtual model. A further advantage of the 

2" present invention is that the motion of the user is 

Si 15 constrained to the virtual surface representing the 

J~ geometric model, to provide the user with an enhanced 

understanding of the geometric properties of the model. 

is— 

Other features and advantages of the present 
invention will be readily appreciated, as the same 
20 becomes better understood, after reading the subsequent 
description taken in conjunction with the accompanying 
drawings . 

BRIEF DESCRIPTION OF THE DRAWINGS 
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FIG. 1 is a diagrammatic view of a 
interactive evaluation of a geometric model. 



system of 
according 
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to the present invention. 

FIG. 2 is a block diagram of the system of 
.interactive evaluation of a geometric model, of FIG.l. 

FIG. 3 is a perspective view of a haptic 
5 interface browsing a virtual surface, according to the 
present invention. 

FIG. 4 is a flowchart of a method of 
interactive evaluation of a geometric model, according 
to the present invention. 
10 FIG. 5 is a diagrammatic view of a haptic 

device position and orientation for a geometric model, 
according to the present invention, 

DESCRIPTION OF THE PREFERRED EMBODIMENT (S) 

15 Vehicle design is achieved according to the 

present invention with a generic, parametric driven 
design process. Advantageously, this process allows 
for flexibility in vehicle design and engineering 
analysis of the design in a fraction of the time 

20 required using conventional design methods. Various 
computer-based tools are integrated to achieve this 
enormous time and expense savings, including solid 
modeling, parametric design, and automated studies. 

Referring to the drawings and in particular 

25 to FIGS. 1 through 3, a system 10 for interactive 
evaluation of a geometric model, according to the 
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present invention, is illustrated graphically. The 
system 10 includes a haptic interface 12 operated by a 
user 14 that controls position, orientation, and force 
feedback between the user 14, a computer system 16, and 
5 a virtual object. It should be appreciated that the 
virtual object is a geometric model representing the 
design form of a physical model. In this example, the 
computer generated geometric model represents a design 
form for a vehicle (not shown) . The vehicle design is 

10 typically generated through the use of conventional 
computer aided design (CAD) , including computer aided 
manufacturing (CAM) .and computer aided engineering 
(CAE) techniques. 

The haptic interface 12 includes a haptic end 

15 effector device 18, such as a stylus, pen, or any other 
similar gripping device. The haptic end effector 
device 18 is grasped by the user 14 . and translates 
information regarding a surface of the geometric model, 
such as sensations of rigidity and facial roughness. 

20 In this example, an active force is applied 

to the haptic end effector device 18, to constrain the 
user' s hand onto a virtual surface 20 representing a 
surface of the geometric model, shown at 22. 
Preferably, the haptic interface 12 includes at least 

25 three degrees of freedom, in order to interact with 
three-dimensional objects. In addition, if the haptic 
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interface 12 has six degrees of freedom, a torque can 
also be applied to constrain the haptic end effector 
device 18, and the user's hand orientation, to follow a 
curvature of the surface 20. By forcing the haptic end 
5 effector device 18 to stick to the surface 20 
representing the geometric model 24, the user 14 
receives tactile information for assessing a quality of 
the geometric design. In particular, if the haptic end 
effector device 18 is constrained to be normal to the 

10 surface 20, it allows for an evaluation of geometric 
properties including curvature changes, 

discontinuities, irregularities, smoothness and 
fairness. In automotive vehicle styling, for example, 
the haptic end effector device 18, in conjunction with 

15 the method of interactive evaluation, to be described, 
enables the user 14 to touch, feel, and edit complex 
three-dimensional CAD geometry. 

The haptic interface 12 also includes a 
hingeable arm 26. In this example, the hingeable arm 

20 26 includes an upper arm 28 and a lower arm 30. The 
haptic end effector device 18 is attached to the upper 
arm 28. The lower arm 30 is attached to a base 32. 
The haptic interface 12 is operatively connected to an 
actuating device 33, such as a servo I/O interface, or 

25 other similar device capable of transmitting forces to 
the end effector through the arms in at least three 
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degrees of freedom. Information regarding an 
interaction with the object is transmitted through the 
haptic end effector device 18 and the arm 26 to the 
computer system 16. For example, the haptic end 

5 effector device 18 provides a physical connection 
between a hand 34 of the user 14 and a computer model 
shown at 22 , cons training the user's motion to always be 
on the surface. In addition, the user 14 can tap on a 
portion of the computer model 22. In this example, the 

10 computer model 22 is a three-dimensional computer-aided 
design of a vehicle, or a portion thereof. 
Advantageously, the haptic interface 12 provides an 
interface between a real world and a virtual world. 

The system 10 further includes a computer 

15 system 16, as is known in the art, operatively 
connected to the haptic interface 12. The computer 
system 16 includes a processor, a controller, and a 
memory to process information relevant to the method of 
interactive evaluation of a geometric model. The 

20 computer system 16 includes a display device 36, such 
as a video terminal, to display the computer aided 
vehicle design. 

The user 14 inputs information into the 
computer system 16 when prompted to do so. Selection 

25 and control of the information within a screen can be 
achieved by the user 14 via a user interactive device 
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38, such as a keyboard. The set of parameters or the 
set of instructions may be specific to the method of 
interactive evaluation of a geometric model, wherein 
other data and information non-specific to the method 
5 may already be stored in the memory of the computer 
system 16. One example of an input method is a pop-up 
dialog box containing available information or 
instructions. For example, information may be 

representative of different vehicle design 

10 alternatives. The computer system 16 utilizes the set 
of information or instructions from the user 14 and any 
other information in carrying out a method, according 
to the present invention and discussed in detail 
subsequently, of interactive evaluation of a geometric 

15 model. 

The system 10 also include a virtual reality 
display system 40. Preferably, the virtual reality 
display system 40 includes a head mounted display 
device 42, as is known in the art. The virtual reality 

20 display device 42 is worn by the user 14 and allows the 
user 14 to "see" a virtual environment. The virtual 
reality display system 40 is in communication with the 
computer system 16, and provides the user 14 a view 
through a virtual human's eyes, or a first person view 

25 of the virtual environment. For example, the position 
of the haptic end effector device 18 is measured. 
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mapped into a reference frame of the mathematical model 
and visually rendered on either the display device 36 
or the head mounted display device 42 or another type 
of graphical display device 42, as is known in the art. 
5 Advantageously, the system 10 can be utilized to 
evaluate a vehicle design based on various factors, 
such as assembly verification, and ergonomics, early in 
the design process. 

In operation, the controller sends the 

10 computer system 16 a signal representing a joint 
position for the joints between the haptic end effector 
device 18, upper arm 28, lower arm 30 and base 32, 
respectively. The computer system 16 sends force 
signals to the controller, which controls the servo I/O 

15 interface 33 to generate the necessary forces applied 
by the haptic end effector device 18. The user 14 can 
view the geometric model 24, such as on the display 
device 36 or in the head mounted display deyice 14. 
The user 14 manipulates the haptic end effector device 

20 18 to "track" along a surface of the geometric model 24. 
The method of the present invention constrains the 
motion of the haptic end effector device 18 to stick to 
the virtual surface 22 of the geometric model 24, to 
enable the user 14 to explore and feel the geometric 

25 model 24. Advantageously, this is a time and cost 
savings as compared to performing the same evaluation 
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using a physical prototype. 

Advantageously, the computer- implemented 
method of interactive evaluation of a geometric model 
combines all of the foregoing to provide an efficient, 
5 flexible, rapid tool for evaluating the design of a 
vehicle. Furthermore, information obtained during the 
subjective evaluation of the design is an output of the 
method and is available for further analysis and study. 

Referring to FIG. 4, a method, according to 

10 the present invention, of interactive evaluation of a 
geometric model is illustrated. Advantageously, the 
methodology provides the user 14 with tactile and 
visual information directly from the computer model. 
The user 14 holds the haptic end effector device 18, 

15 and the motion of the haptic end effector device 18 is 
constrained to the surface 22 of the geometric model 
24, and oriented normal to the surface 22. The user 14 
can apply the methodology for assessing the smoothness, 
fairness or other geometric property of the surface 22. 

20 The" method begins in block 100 and continues to block 
105. 

In block 105, the user 14 selects a geometric 
model 24 for assessing its geometric properties, and 
the model 24 is imported into the methodology. 
25 Preferably, the geometric model 24 is a computer 
generated, computer-aided design (CAD) model, digital 
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buck or other mathematical or geometric representation, 
and is maintained in a computer database. The 
geometric model 24 is represented using a known data 
format, such as a set of NURBS, a three-dimensional 
5 solid CSG or a polygonal soup. In this example, the 
geometric model 24 represents a vehicle, and in 
particular a portion of a body of- the vehicle. 
Further, the user 14 may select a surface 22 
representing a section of the geometric model 24 to 

10 evaluate, such as by drawing a box (not shown) around 
the desired section of the geometric model 24 to 
evaluate using a user interactive device 38 such as a 
mouse. It should be appreciated that the drawing 
process includes a click, drag and release of the 

15 mouse, as is known in the art. The methodology advances 
to block 110. 

In block 110, the methodology configures the 
geometric model 24 as a parametric surface, so that 
each point representing the model 24 is uniquely 

20 identified by a set of coordinates within a known 
coordinate system. An example of a parametric surface 
is a NURBS surface, other surface representations like 
a tessellated mesh can be parametrized such as that 
described in U.S. Patent No. 5,903,458 to Stewart et 

25 al., entitled ''System and Method for Forming Geometric 
Features Using Global Reparametrization" . In addition. 
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a computer program such as SDRC I-DEAS is commercially 
available for configuring a CAD model as a parametric 
surface. The methodology advances to block 115. 

In block 115, the methodology determines a 
5 haptic end effector device position within a haptic end 
effector device coordinate system reference frame, for 
use in determining the haptic end effector device 
position and orientation. Preferably, a workspace 
reference frame, origin (0,0,0) and scale of the 

10 geometric model 24 is established, so that the 
reference frames of the haptic end effector device 18 
and geometric model 24 are coordinated. The haptic end 
effector device position Phardware represents the physical 
position of the haptic end effector device 18, and the 

15 orientation of the haptic end effector device 18 is 
represented by a normal to the surface of the geometric 
model 24, referred to as Nhardware. Preferably, the haptic 
end effector device position is established using a 
tracking technique, as is known in the art. The 

20 methodology advances to block 120. 

In block 120, the methodology maps the haptic 
end effector device position Phardware and orientation 
Nhardware into the geometric model reference system, which 
in the example is a CAD model. For example, the haptic 

25 end effector device position is mathematically derived 
by multiplying a predetermined factor fp by the haptic 
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device position Phardware as follows: 

^device = fp (^hardware) • 

The orientation of the haptic end effector device 18 is 
similarly mapped into the CAD space using: 

^ l^device = (^hardware) - 

Pdevice and Ndevice represent the new position and 
orientation of the haptic device 18 mapped into the 
reference system for the CAD model. As illustrated in 
FIG. 5, the haptic end effector device position Pdevice 

10 shown at 50 and orientation Ndevice shown at 52 are 
mapped into the surface of the CAD model 20. The 
methodology advances to block 125. 

In block 125, the methodology finds a closest 
point Psurface and orientation Nsurface on the CAD model, to 

15 the haptic end effector device position, Pdevice- As 
illustrated in FIG. 5, Psurface and n^^^face are shown at 54 
and 56, respectively. An example of a mapping technique 
is disclosed in U.S. Patent No. 5,694,013 entitled 
''Force Feedback Haptic Interface for a Three- 

20 Dimensional CAD Surface", the disclosures of which is 
hereby incorporated by reference. The methodology 
advances to block 130. 

In block 130, the methodology extracts 
surface properties of the CAD model at the closest 

25 point position Psurface and orientation Nsurface- An 
example of a surface property is surface normal SNgurface/ 
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or a curvature value Sksurface - The surface properties 
can be computed using known techniques. For example, an 
analytical technique is used if the geometric 
representation is the true description of the geometric 
5 model 24, such as with a NURBS surface. Alternatively, 
the surface properties can be computed by interpolation 
or shading if the geometric representation is, by way 
of example, a polygonal tessellation or a volumetric 
approximation. The methodology advances to block 135. 

10 In block 135, the methodology maps the 

surface properties of the closest point position Psurface 
and orientation Ns^rface into a position or orientation 
vector. Advantageously, the reference frame of the 
position or orientation vector is generic, in order to 

15 map from one physical domain into another. For example: 

^surface ~ fsp (SKgurface) 
^surface — f SN ( SNsurface ) 

The methodology advances to block 140. 

In block 140, the methodology maps the point 
20 Psurface ^nd Orientation Ngurface surface properties into 
the haptic end effector device reference system space 
from the position or orientation vector. For example: 

Psurface ~ hw ~ fp (^surface) 
^surface ~ hw ~ fn (^^surface) 

25 The methodology advances to block 145. 

In block 145, the methodology computes a 
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force feedback representing a stick-to-surface force, 
and a property-feedback force. Advantageously, the 
properties of the surface are tactilely conveyed to the 
user 14 by constraining the haptic end effector device 

5 18 to the surface 20. In this manner, the user 14 can 
feel the surface properties. The orientation of the 
haptic end effector device 18 is used to provide the 
user 14 with feedback as to what properties are 
changing on the ' surf ace 22 of the model 24. The stick- 

10 to-surface force conveys the attraction of the haptic 
end effector device 18 to the surface 20 of the model 
24. Also, the stick-to-surface force maintains the 
orientation of the haptic end effector device 18 
parallel to the normal of the surface 20, and the 

15 haptic end effector device 18 in contact with the 
surface 20. For example, the mathematical relationship 

Psurface_hw " ^hardware iS USed tO COntrol the force OUtput 

of the haptic end effector device 18 to constrain the 
tip of the pen to the surface using: 



torque applied to a tip of the haptic end effector 
device 18, to constrain the orientation of the haptic 
end effector device 18 to match the selected surface 
25 property to the user 14. For example, the mathematical 
relationship Nsurface hw - Nhardware is used to control the 
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The 



property-feedback force represents a 
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force output to convey surface properties to the user 
using : 

^sp ~ fsp (^surface_hw ~ ^^hardware ) • 

The methodology advances to block 150. In 
5 block 150, the stick-to-surface force, Fstick and 
property feedback force, Fsp, are added together and 
applied to the haptic end effector device 18. 
Advantageously, the user's hand 34 is constrained to 
the virtual surface 20 as he/she browses the surface 20 

10 using the haptic end effector device 18. The user 14 
receives tactile and visual stimulation directly from 
the computer model 24. Geometric properties such as 
curvature changes , discontinuities, irregularities, 
smoothness and fairness are conveyed to the user 14, 

15 that could previously only be conveyed via a physical 
prototype . 

Preferably, Psurface and Ng^rface are used as 
reference values to control the location and/or force 
output of the haptic end effector device 18. For 

20 example, the distance Dsurface between Psurface and Phardware 

shown at 58 in FIG, 5, and the angular displacement Arpy 
shown at 60 in FIG. 5 are determined. The angular 
displacement A^py is the difference between Ngurface and 
Nhardware/ expressed in Roll-Pitch-Yaw (RPY) angles, as is 
25 understood in the art. The orientation of the haptic 
device is also expressed in RPY. 
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Next, it is determined whether Dsurface and A^py 
are less then threshold vectors Dthrsid and Athrsid, 
respectively. A torque vector as shown at 62 is 
applied at the haptic end effector device actuators 33 
5 that will produce an equivalent force or torque at the 
haptic end effector device 18, that is proportional to 
Dsurface and Arpy, and orientated along their respective 
vectors. It should be appreciated that if the haptic 
end effector device 18 is a predetermined distance from 

10 a target position and orientation of the surface, an 
incrementally decreasing force is applied to the haptic 
end effector device 18, to maintain the stability of 
the system 10 and avoid the application of an 
excessively large force to the user 14. 

15 The methodology advances to block 155 and 

ends. It should be appreciated that the methodology is 
executable in an iterative manner, for the user 14 
browsing the surface 22 of the geometric model 24. It 
should also be appreciated that a parallel process 

20 operating on the computer system 16 may periodically 
display the geometric model 24 and a simplified 
representation of the haptic end effector device 18 
onto the 2-dimensional display device 36, or the head 
mounted display mechanism 42. 

25 The present invention has been described in 

an illustrative manner. It is to be understood that 
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the terminology, which has been used, is intended to be 
in the nature of words of description rather than of 
limitation . 

Many modifications and variations of the 
5 present invention are possible in light of the above 
teachings. Therefore, within the scope of the appended 
claims, the present invention may be practiced other 
than as specifically described. 



